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DIFFERENCE PROPHET INEQUALITIES FOR [0,1]-VALUED I.I.D. 
RANDOM VARIABLES WITH COST FOR OBSERVATIONS^ 

By Holger Kosters 
University of Munster 

Let Xi,X 2 ,--- be a sequence of [0, l]-valued i.i.d. random vari¬ 
ables, let c > 0 be a sampling cost for each observation and let Yi = 

Xi -ic, i = 1,2,-For n = 1,2,..., let M(Yi,..., y„) = _E(maxi<i<„ Yi) 

and V (Yi,..., Yn) = sup^g(;jTi E{Yt), where C" denotes the set of all 
stopping rules for yi,...,Y'„. Sharp upper bounds for the difference 
M(Yi ,... ,Yn) — V (Li ,... ,Yn) are given under various restrictions on 
c and n. 

1. Introduction. In her interesting paper, Samuel-Cahn (1992) investi¬ 
gated “prophet inequalities” for [0, l]-valued i.i.d. random variables with 
cost for observations; Let Xi,X 2 ,... be i.i.d. random variables, 0 < Vj < 1, 
and let c > 0 be a fixed sampling cost that is charged for each observation. 
Consider the sequence Yi = Xi — ic, i = 1,2,..., and for n = 1,2,..., let 
M(Yi,..., Yn) = E{maxi<i<n Yi) and V(Yi,..., Vn) = sup^g,^^ E{Yr), where 
C"’ denotes the set of stopping rules for Yi,... ,Yn. Then M{Yi,... ,Yn) and 
V{Yi ,..., Yn) can be interpreted as the expected optimal return of a prophet 
and a statistician, respectively. For any real number x, let [x] denote the 
largest integer strictly smaller than x. Samuel-Cahn (1992) stated her main 
result as follows: 

Let Vi, V 2 ,... be i.i.d. random variables, 0 < Xi < 1. 

(a) For 0 < c < 1 fixed and all n > 1, 

M(yi,..., - ^(^ 1 , • • •, ^n) < [i/c]c(i - c)[^/^i+h 

(b) For n > 1 fixed and all c > 0, 

M(yi, ...,Yn)-V{Yi,...,Yn)<{l- l/n)^+\ 
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(c) For all c > 0 and all n > 1, 

M{Yu...,Yr,)-V{Yi,...,Yn)<e-\ 

All bounds are the best possible. 

Unfortunately, Harten (1996) detected a gap in the proof (the argument 
for the reduction to Bernoulli variables is incomplete) and even showed that 
the inequality in (a) fails to hold for c > 1/2 and that the inequality in (b) 
fails to hold for n > 2 (see also the remarks below). Moreover, because the 
original proof of result (c) was based on result (b), a new proof for this part 
became necessary as well. 

Harten gave the correct upper bound for part (a) and provided a new 
proof for part (c) based on this result. With regard to part (b), Harten 
conjectured that the correct upper bound is (n — 1)(1 — l/(n + l))”'/(n + 1), 
but he proved this result only for the special case of Bernoulli variables (see 
Lemma 2.1). The purpose of the present note is to extend this result to 
arbitrary [0, l]-valued i.i.d. random variables. To summarize, we present the 
following complete result: 


Theorem. Let Xi,X 2 , ... be i.i.d. random variables, 0 < Xi < 1. 

(a) For 0 < c < 1 fixed and all n>l, 

M{Y-[ Y ) — ViY^ y ) < I ~ for c < 1/2, 

M[ru...,rn) for c>l/2. 

(b) For re > 1 fixed and all c > 0, 

M(yi,..., Tn) - y(yi,..., y„) < (re - 1)(1 - l/(re + l))”/(re + 1). 

(c) For all c>0 and all n>l, 

XIiYu...,Yn)-V{Yu...,Yn)<e-\ 

All bounds are the best possible. 


The proof of part (a) can be found in the Ph.D. thesis of Harten (1996) 
or in Section 8(c) of Harten, Meyerthole and Schmitz (1997). It proceeds 
roughly as follows: In the case EXi < c, the problem can first be reduced 
to that for Bernoulli variables [i.e., random variables Xi such that P{Xi = 
1) = p = 1 — P{Xi = 0) for some 0 < p < 1] and then be solved by direct 
calculation. In the case EXi > c, the basic idea is to apply Theorem A 
from Jones (1990) to the sequence V {Y2, ..., Yn),Y2,... ,Yn and to use some 
suitable estimates. 

The proof of part (b), presented in the following section, is somewhat 
similar in that we also distinguish the cases EXi < c and EXi > c. However, 
in the second case we use a completely different argument. 

Part (c) follows easily from part (a) or part (b), since e~^ is the supremum 
of the respective upper bounds. 
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Remarks, (a) The following examples, taken from Harten (1996), show 
that the upper bounds are attained in the cases (a) and (b): In (a) take 
n > [1/c] + 1 and i.i.d. random variables Xi,... ,Xn with P{Xi = 1) = c = 

1 — P{Xi = 0) for c < 1/2, and P{Xi = 1) = 1/2 = 1 — P(Xi = 0) for c > 

1/2. In (b) take c= l/(n + 1) and i.i.d. random variables Xi,... ,Xn with 
P{Xi = 1) = l/(n + 1) = 1 — P{Xi = 0). We note without proof that, except 
for c = 1 in (a) and n = 1 in (b), the upper bounds are attained only in these 
cases. 

(b) The inequalities in parts (a) and (c) remain true for infinite sequences 

of [0, l]-valued i.i.d. random variables. See Harten (1996), Harten, Meyerthole and Schmitz 
(1997) or Saint-Mont (1999) for a more general presentation. 

(c) It seems natural to look also for ratio prophet inequalities, that is, 
for inequalities of the type M{Yi,Yn)/V (Yi ,Yn) <C. However, this 
ratio turns out to be unbounded for all re > 1 and all 0 < c < 1, as already 
observed by Samuel-Cahn (1992). 

(d) The case c = 0 was treated by Hill and Kertz (1982), who showed 
that M{Yi ,..., Yn)/V{Y ,,..., T^) < and M{Yi ,..., y„) - H(yi,..., y„) < 
bn for all re = 2,3,..., with certain constants 1.1 < an < 1.6 and 0 < 6^ < 

1/4. These results are markedly different from those for the case c > 0 and 
seemingly cannot be obtained from them. Quite on the contrary, the second 
inequality is a key ingredient in our proof of part (b). 

2. Proving part (b). Throughout this section, assume that re > 2 (oth¬ 
erwise the assertion is trivial), and let D{Yi,...,Yn) := M{Yi,... ,Yn)— 

V (Ti,..., Yn) and dn := (re — 1)(1 — l/(re -|- l))"'/(re -P 1). It remains to prove 
that 

(1) D{Yu...,Yn)<dn. 

The examples given at the end of the Introduction then show that this bound 
is also the best possible. 

In two special cases, the Bernoulli case and the zero-cost case, (1) can 
easily be deduced from existing results: 

Lemma 2.1. For all c>0 and all i.i.d. random variables Xi,...,Xn 
with P{Xi = 1) = 1 - P{Xi = 0), D{Yi, ...,Yn)<dn. 

Proof. For c = 0 and c > 1, D{Yi ,..., Yn) = 0 < dn, since the statisti¬ 
cian can secure the same return as the prophet by using the stopping rules 
r = \ni{i\Xi = 1 or i = re} and r = 1, respectively. For 0 < c < 1, the result 
is obtained by direct calculation, and can be found in Harten [(1996), pages 
142 and 143] or Harten, Meyerthole and Schmitz [(1997), pages 194---196]. 

□ 
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Lemma 2.2. Suppose that c = 0. Then for all i.i.d. random variables 
Xi,..., Xn taking values in [0,1], D{Yi ,..., Yn) < dn- 

Proof. For c = 0, Theorem B in Hill and Kertz (1982) states that 
D{Yu...,Yn)=D{Xi,...,Xn)<bn 

for certain constants 0 < < 1/4 [see Hill and Kertz (1982) for definitions]. 

Hence it remains to show that bn < dn- For n > 5 this follows from dn > 1/4. 
For n < 4, we can go back to the definitions to verify the inequalities 62 — 
0.063 < 0.148 ^ d 2 , 63 = 0.077 < 0.211 ^ d^ and 64 = 0.085 < 0.246 ^ d^ [see 
also Example 3.9 in Hill and Kertz (1982)]. □ 

We now show that (1) remains true for any c > 0 and any [0,1]-valued 
i.i.d. random values Xi,... ,Xn by relating the general case to the above- 
mentioned special cases. 

In doing so, we use that, from Theorem 3.2 in Chow, Robbins and Siegmund 
(1971), 

(2) ViYi,. ..,Y)= E{max{Xi,V{Yi ,..., K_i)}) - c 

for all i > 1. Furthermore, we use the usual balayage technique [the reduction 
to distributions with maximum variance; see Section 2 in Hill and Kertz 
(1982)]. For any integrable random variable Y and any —00 < a <b < 00 , let 
Y^ denote a random variable with Y^ = Y for Y ^ [a, 6 ], = a with probability 
{b - a)-i JYe[a,b](b - Y) dP and = b with probability (6 - 0 )-^ JYe[a,b]0^ “ 
a) dP. Then EY^ = EY and if X is any random variable independent of Y 
and Y^, 

(3) E{max{X,Y}) <E{max{X,Y^}). 

Proof of part (b). For c = 0, the assertion has just been established. 
For c > 0 and EXi < c, we follow Harten [(1996), Proposition 12.4] and 
reduce the problem directly to that for Bernoulli variables. Let Xi,... ,Xn 
be i.i.d. random variables, where Xi := (Wi)q is a 0-1 balayage of Xi and 
independent of Xi,..., Xn, and let Yi = Xi — ic, i = 1,... ,n. Then it follows 
from (2) and (3) that V (Li, ... ,Yi) = V (Ki, ... ,Yi) for all i = 1,..., n and 
M(y'i, ...,Yn\> XI{Yi, ...,Yn). Therefore, D{Yi ,..., W) < D{Yu ..., Yn), but 
now Xi,... ,Xn are Bernoulli variables, so referring to Lemma 2.1 yields (1). 

For c > 0 and EXi > c, a direct reduction to Bernoulli variables does not 
seem possible, so we have to take a different approach. For better clarity, we 
split the proof into several steps: 

First of all we show that we may restrict ourselves to i.i.d. [0, l]-valued 
random variables Xi,..., Xn such that 

X* := inf{x G M|P(Xi < x) > 0} = 0, 

X* := sup{x G Mjp(Xi < x) < 1} = 1, 


( 4 ) 
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that is, the length of the interval [0,1] is fully exhausted: 

Lemma 2.3. Let Xi,... ,Xn be i.i.d. [Q,V\-valued random variables and 
let c > 0. Then there exist i.i.d. [0,l]-valued random variables Xi,...,Xn 
with 

x* := inf{a; G M|P(Xi < ai) > 0} = 0, 

X* := sup{x G M|P(Xi < x) < 1} = 1 

and c > 0 such that ..., Yn) < D{Yi,... ,Yn). Here let % be defined by 

Yi := Xi — ic, i = 1,..., n. 

Proof. Let x*,x* be defined as in (4). 

For X* = X*, we have M (Yi ,... ,Yn) — V (li ,... ,Yn) = 0, and choosing 
i.i.d. random variables Xi,... ,Xn with P{Xi = 1) = 1/2 = 1 — P{Xi = 0) 
and c := c yields the assertion. 

For X* < X*, consider the random variables Xi,... ,Xn dehned by Xi := 
{Xi — X*)/(x* — X*). These are obviously a.s. [0, l]-valued i.i.d. random vari¬ 
ables with X* = 0 and x* = 1, and setting c := c/(x* — x*) [> 0], we also 
have 

M{Y,...X)-V{Yi,...X) 

= {M{Yu ...,Yn)- x*)/(x* - X*) - {V{Yi, ...,Yn)- x,)/{x* - X*) 
>M{Yu...,Yn)-V{Yi,...,Yn). 

Thus, after a modification on a null set if necessary, the random variables 
Xi have the desired properties. □ 

Note that in the preceding reduction step, we possibly get from the case 
c > 0, EXi > c to the case c > 0, EXi < c. This being supposed, the first 
part of the proof yields the assertion. Hence it remains to consider the case 
c > 0, EXi > c. 

Next we follow Hill and Kertz [(1982), Lemma 2.4] and show that we 
may restrict attention to special discrete distributions. Indeed, it suffices to 
consider i.i.d. [0, l]-valued random variables X\,... ,Xn such that 

/.x P{Xl G {l,Vn-l,Vn-2, ■ ■ . ,U2,Ui,0}) = 1, 

P(Xi = l)>0, P(Xi=0)>0, 

where Vi := V{Yi ,..., Yi), i = 1,... ,n — 1. 


Lemma 2.4. Let Xi,... ,Xn be i.i.d. [0,l]-valued random variables satis¬ 
fying condition (4), letc> 0 and suppose that EXi > c. Let Vi := V (Yi,...,!/), 
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i = 1,..., n — 1. Then 1 > Vn-i > Vn -2 > ■ ■ ■ > V 2 > vi > {) and there exist 
i.i.d. [0, l]-valued random variables Xi,... with 

P{Xl £ {l,Vn-l,Vn-2, ■ ■ ■ ,V2,Vl,0}) = 1, 

P{Xi = 1) > 0, P{Xi = 0) > 0 

and 

y(Fi, ...,Yi} = Vi = V{Yi, ...,Y^ foralli = l,...,n-l 

such that DiYi, ..., Yn) < D{Yi, ..., Yi)- Here let Y be defined by Y := Xi — 
ic, i = 1,..., n. 

Proof. We begin by proving the inequality 1 > Vn-i > Vn -2 > ■ • • > 

U2 > ui > 0. Clearly, Uj < 1 — c < 1 for all i = 1,... ,n — 1. Furthermore, 
vi = EXi — c > 0 by assumption. Moreover, if vi > Uj_i holds for some 
i G {1 ,...,n — 2} (where vq := 0), (2) yields Uj+i = ii^(max{Xi,u,}) — c > 
Fi(max{Xi,Ui_i}) —c = Vi, where the strict inequality follows from the as¬ 
sumption X* = 0. 

Now, using the balayage technique, choose i.i.d. random variables Xi,..., Xn 
with the same distribution as ((• • • ((^i)o^)^j ■ • • Then it is obvious 

that 

P{Xi £ {l,U„_i,U„_2,...,U2,Ui,0}) = 1, 

P{Xi = 1) > 0, P{Xi = 0) > 0. 

(For the inequalities, we need the assumptions x* = 1 and x* = 0.) Further¬ 
more, the same argument as in the proof of Lemma 2.4 in Hill and Kertz 
(1982) shows that V {Yi,... ,Y) = V (Yi,..., Yj) for alH = 1,..., n and M (Yi ,... ,Yn 
M{Yi, ...,Yn), whence Z)(Yi,..., Y„) < D{Y, ...,Yn)- □ 

Note that in this reduction step, passing from the Xi to the Xi leaves the 
expectation unchanged, so that we stay in the case c> 0, EXi > c. 

Whereas in the i.i.d. case without observation costs, the reduction to 
special discrete distributions leads to a tractable formula for computing 
M (Yi,..., Yn) with the aid of the distribution function of Xi [see Hill and Kertz 
(1982), Lemma 2.5], such a procedure does not seem to be possible in the 
i.i.d. case with observation costs. The reason for this is that we do not know 
enough about the order relationships between the Vi — he, i = 1 ,... ,n — 1, 
h = 1,... ,n. 

To circumvent this problem, we embed the random variables Yi,...,l^ 
into a whole family of random variables Yi{(5 ),..., Yn{fi) in such a way that 
(i) we can easily bound the difference D{Yi{P),... ,Yn{P)) from above for 
two special values of the parameter (5 and (ii) the resulting bounds lead to 
an upper bound for the original difference D{Yi,... ,Yn). 
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Lemma 2.5. Let Xi,... ,Xn be i.i.d. [Q,l]-valued random variables and 
let c> 0 such that the conditions EXi > c and (5) are satisfied. Then 

c' := c - P{Xi = 1) < 0. 

Proof. Suppose by way of contradiction that c' > 0, that is, P{Xi = 

1) < c. Since with probability 1, Xi takes on the values 0 < ui < • • • < Vn-i < 

1 only, we obtain 

Vn-i = E{max{Xi, Vn- 2 }) - c 

= Vn-2 ■ P{Xi < Vn-l) + Vn-1 ' P{Xi = Vn-l) + P{Xi = 1) - C 
^ '^n—1 ' P(^l ^ Vji—l') “1“ Vn—1 ■ P{Xi — Vn—l') < Vn—t, 

where the last inequality follows from P{Xi = 1) > 0. This contradiction 
proves the lemma. □ 

Construction 2.6. Let Xi,... ,Xn be i.i.d. [0, l]-valued random vari¬ 
ables, let c> 0 such that the conditions EXi > c and (5) are satished, and 
let P* := —P{Xi = Pjjd (> 0) (with d as in Lemma 2.5). We now con¬ 
struct a family of random variables {Xi(/3),..., AL„(/3)}^g[o,/3*] with corre¬ 
sponding sampling costs {c(/3)}/3g[o,/3*]- For all G [0,/3*], let Uj(/3) := ■ Vi, 

i = 1,..., n — 1, 

r 1, on {Xh = 1}, 

XhiP) ■= { ViiP), on {Xh = Vi}, h=l,...,n, 

[ 0, on {Xh = 0}, 

and c(/3) := ■ d + P{Xi = 1). Finally, let 

Yh{P):=Xh{P)-h-c{p), h=l,...,n. 

Note that fi* = —P{Xi = l)/d is the (uniquely determined) zero of the 
strictly decreasing function ^ ■ d + P{Xi = 1). Since 1 ■ d + P{Xi = 

1) = c > 0, this implies /3* > 1 > 0. In particular, /? = 1 is an admissible 
parameter. Furthermore, c(/3) > 0 for all G [0,/9*], with equality holding if 
and only li . 

Lemma 2.7. Given the situation of Construction 2.6, we have: 

(a) For P = 1, the XfiP) and c(/3) coincide with the Xi and c. 

(b) For each P £ {0, P*), Xi{P),Xn{P) are i.i.d. [0,1]-valued random 
variables such that condition [5) is satisfied with respect to the sampling cost 
c{P). 

(c) For P = 0, Xi{P),... ,Xn{P) are i.i.d. random variables with P{Xi{P) = 
1) = 1 - P{Xi{P) = 0) and c{P) = P{Xi = 1). 
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(d) For (3 = (5*, Xi{(5),... ,X„(/3) are i.i.d. [0, l]-valued random variables 
and c{(5) = 0. 

Proof. Statement (a) is obvious from the definitions. 

To prove (b)"(d), let /3 := sup{/3 G [0,/?*]|u„_i(/3) < 1}. Since Vn-i(l) = 
Vn-i < 1, we have /3 > 1. Furthermore, it is obvious that 

(6) 0 < vi(/3) < ■ ■ ■ < Vn-i(/3) < 1 

for all /9 S [0,/3], where the first re — 1 equalities hold exactly for /3 = 0 and 
the last equality holds at most for fd = (5. 

We now show by induction on h that 

(7) V{Yi{P),...,Yhm = Vhm for all/3G[0,/3] 

for all /i = 1,..., re — 1. First note that Xi{(5 ),..., Xn{P) are again i.i.d. ran¬ 
dom variables and that with probability 1, Xi{(5) = ^-Xi + l{jis:i=i}- 

Setting uo := 0, uo(/3) := 0 for h = I and using the inductive hypothesis 
V (Yi(/3),..., Y/i_i(/3)) = Vh-i{P) for /i = 2,..., re — 1, we therefore obtain 

V{Y,{f3),...,Yhm 

= E{ma-x{Xi{P),Vh-i{P)}) - c{(3) 

= E(max{Xi(/3),u;,_i(/3)} • = 1) - /? • c' - P(Xi = 1) 

= (5 • (F;(max{Wi, = 1) - c' - P{X^ = 1)) 

= /3- {E{max{Xi,Vh-i}) - c) 

= P-V{Y^,...,Yh) = f3-Vh = Vh{f3), 
which proves (7). 

We now show that (3 = (3*. By definition it is clear that (3 < (3*. Suppose 
by way of contradiction that (3 < (3*. Then for monotonicity and continuity 
reasons we have 0 < vi{$) < ■ ■ ■ < Vn-i{$) = 1 and c(/?) > 0 and therefore 

1 = Vn-lW) = P(Yl(/3), . . . , Tn-l(/3)) < 1 - C0) < 1, 

that is, a contradiction. Hence $ = (3*. 

It follows that (6) even holds for all (3 G [0, /3*]. Since the other properties 
mentioned in (b)"(d) are obvious now, the proof is complete. □ 

Lemma 2.8. The function j3 {(3) ■.= V{Yi{l3),... ,Yn{l3)) is linear. 

Proof. Similarly as in (7), we have V(Yi{j3),... ,y„(/3)) = j3-V{Yi,... ,Yn) 
for all (3 G [0, [3*]. □ 

Lemma 2.9. The function (3 1—> M{(3) := M{Yi{f3),... ,Yn{f3)) is convex. 
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Proof. For almost every cj G Q, the “path” 

(5 ^ Y*{P] io) := max{Yi (/3; uj),Y2{/3;uj), ..., YniP] w)} 

is convex, since it is the maximum of the affine-linear functions f3 i—> hi(/3; w). 
Thus the function P i—;• M{P) = E{Y*{P)) is also convex. □ 

Continuation of the proof of part (b). We are now in a position 
to complete the proof of part (b). Let Xi,X2 ,... and let c be such that 
c > 0, EXi > c. By Lemmas 2.3 and 2.4, we may assume that condition 
(5) is satisfied (see also the remarks below Lemmas 2.3 and 2.4) and that 
Construction 2.6 is applicable. Then the function P D{P) := M{P) — V{P) 
is convex, since it is the difference of a convex and a linear function. Since a 
convex function defined on a compact interval always attains its maximum 
on the boundary of its domain, it follows that 

(8) D{Yi ,..., T„) = D{1) < max{L»(0), Z)(/3*)}. 

Now, on the one hand, we have Bernoulli variables for P = 0 [Lemma 2.7(c)], 
which implies D{0) < dn by Lemma 2.1; on the other hand, we have c{P) = 0 
for P = P* [Lemma 2.7(d)], which implies D(P*) < dn by Lemma 2.2. Hence 
the maximum in (8) is bounded above by dn, which proves (1). □ 

Acknowledgments. I thank Professor N. Schmitz for the problem state¬ 
ment and for his friendly and constant support. Furthermore, I am grateful 
to the reviewers for their helpful comments on a previous version of this 
paper. 


REFERENCES 

Chow, Y. S., Robbins, H. and Siegmund, D. (1971). Great Expectations-. The Theory 
of Optimal Stopping. Houghton Mifflin, Boston. MR331675 
Harten, F. (1996). Prophetenregionen bei zeitlichen Bewertungen im unabhangigen und 
im iid-Fall. Ph.D. thesis, Univ. Munster. MR1407740 
Harten, F., Meyerthole, A. and Schmitz, N. (1997). Prophetentheorie. Teubner, 
Stuttgart. MR1476178 

Hill, T. P. and Kertz, R. P. (1982). Comparisons of stop rule and supremum expecta¬ 
tions of i.i.d. random variables. Ann. Probab. 10 336-345. MR647508 
Jones, M. L. (1990). Prophet inequalities for cost of observation stopping problems. J. 
Multivariate Anal. 34 238-253. MR1073108 

Saint-Mont, U. (1999). Prophet regions for iid random variables with simultaneous costs 
and discountings. Statist. Decisions 17 185-203. MR1714115 
Samuel-Cahn, E. (1992). A difference prophet inequality for bounded i.i.d. variables, 
with cost for observations. Ann. Probab. 20 1222-1228. MR1175260 

Institut fur Mathematische Statistik 
Universitat Munster 
Einsteinstrasse 62 
D-48149 Munster 
Germany 

E-MAIL: koestho@math.uni-muenster.de 


